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Abstract 

The concept of femtocell access points underlaying existing communication infrastructure has 
recently emerged as a key technology that can significantly improve the coverage and performance 
of next-generation wireless networks. In this paper, we propose a framework for macrocell-femtoceU 
cooperation under a closed access policy, in which a femtocell user may act as a relay for macrocell 
users. In return, each cooperative macrocell user grants the femtocell user a fraction of its superframe. 
We formulate a coalitional game with macrocell and femtocell users being the players, which can take 
individual and distributed decisions on whether to cooperate or not, while maximizing a utility function 
that captures the cooperative gains, in terms of throughput and delay. We show that the network can self- 
organize into a partition composed of disjoint coalitions which constitutes the recursive core of the game 
representing a key solution concept for coalition formation games in partition form. Simulation results 
show that the proposed coaUtion formation algorithm yields significant gains in terms of average rate 
per macrocell user, reaching up to 239%, relative to the non-cooperative case. Moreover, the proposed 
approach shows an improvement in terms of femtocell users' rate of up to 21% when compared to the 
traditional closed access policy. 

Index terms: spectrum leasing; femtocell networks; coalitional game theory; Device-to-Device (D2D); 
cooperation; recursive core. 
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I. Introduction 

The new shifts in wireless communication paradigms, the need for energy-efficient commu- 
nication, and the ever-increasing demands for ubiquitous wireless access and higher data rates 
led to increased research tackling the problem of deploying low cost, low power, femtocells. In 
fact, the challenges of introducing femtocell access points have attracted an increased attention 
from both academia as well as standardization bodies such as the Third Generation Partnership 
Program (3GPP). It is envisioned that by introducing small cells, i.e., femtocells, serviced 
by dedicated femtocell access points, high quality indoor coverage can be achieved without 
any extra investments in network infrastructure, such as adding base stations or deploying 
advanced antenna systems. In addition, due to their ability to connect to existing backhaul 
networks (e.g., DSL), femtocells are an enabler for offloading traffic from existing wireless 
systems (e.g., cellular networks) and, subsequently, they can improve both spectrum efficiency 
and network capacity. As a result, two-tier femtocell networks, which consist of a macrocell 
network underlaid on femtocell access points (FAPs) are expected to lie at the heart of emerging 
wireless systems [[II, 0, 0, Iffl, [H- 

The deployment of femtocells underlaid with an existing macrocell wireless network is 
accompanied with numerous technical challenges at different levels, such as spectrum allocation, 
handover, interference management and access policy. From a cross-tier interference standpoint, 
orthogonal spectrum allocation can entirely eliminate interference but is inefficient in terms of 
spectrum utilization [[6[[. As a result, from a network operator's perspective, deploying co-channel 
femtocells is of great interest [[7][, [[H. Through co-channel operations, femtocell access points 
are able to reuse the spectral resources of the macrocell network and, hence, improve the spectral 
efficiency, especially when traffic loads are high. However, in co-channel operations, cross-tier 
(i.e., macro- to femtocell, and vice versa) as well as intra-tier (i.e., inter-femtocell) interference 
can seriously degrade the system performance [[U, |[T0[| . In order to mitigate both types of 
interference, a variety of decentralized solutions are provided in [[TT|. [[T2|. [[T3l . [[T4|. [[TSl . 
[[T6l . |[T7l . [[TSl . |[T9l and can be divided in two categories: self-organization and cooperative 
strategies. The former class includes non-cooperative mechanisms of adaptation to the operating 
scenario and the interference environment, and deals with dynamic spectrum occupation [[20l , 
power control [[TSll . |[2T1l and interference cancelation |[22]| . Self-organization relies on context 
awareness capabilities and the paradigm of learning through trial- and-errors |[23l . [[T9ll . [[TTl . 
Clearly, its key benefit is the scalability and the timeliness of the solutions, since the intelligence 
lies at the lower levels of the network architecture. One alternative approach is to leverage off 
the cooperation for interference management as done in |[T6ll . [[24|. [[25l . Nevertheless, both 
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self-organizing and cooperative solutions are associated with a cost or effort which can limit 
their benefits and, therefore, obtaining an optimal approach is quite challenging. In two-tier 
femtocell networks, different limitations can be witnessed at the mobile users' side. On one 
hand, macro users (MUEs) are generally bandwidth limited and suffer from low signal to noise 
and interference ratios (SINRs), especially when located at the cell boundary area. This is often 
reflected by a large number of outage events and a consequent increase in the user-plane delay. 
On the other hand, femtocell access points (FAPs) are interference limited, therefore, a cross-tier 
cooperative scheme has to provide a benefit from different angles. In essence, some of the main 
open issues faced when designing cooperative schemes for femtocell networks are: 

• How can the cooperation among users belonging to different tiers be modeled? 

• What is the price for cooperation and when is cooperation beneficial? 

• How to provide incentives to encourage cooperation? 

In femtocell deployment, three main access control policies for femtocells can be recognized 
[|26]| : closed, open, and hybrid. In the closed access policy, femtocell subscribers constitute 
the closed subscribers group (CSG) and are the only ones allowed to connect to the belonging 
femtocell. In the open access policy, non-subscribers may also connect to any femtocell, without 
any restriction. Lastly, in hybrid access policies, non- subscribers may connect to a femtocell 
only under particular circumstances, depending on the resource availability. One promising 
approach for cross-tier interference management is to enable open or hybrid access policies 
at the femtocells, so that the effects of macro- to femtocell interference is reduced as shown 
in ll27l . Il28l . for open access. A general introduction on the issues of coexistence between 
macrocells and femtocells is provided in ll25l . [|7]|, in which the authors present various practical 
scenarios. Alternatively, the MBS can coordinate or direct main operations at the FAP by means 
of information exchange over the X2 interface or through the femtocell gateway ll29l . However, 
in large networks, the computational effort resulting from this procedure at the MBS can be 
high as it requires excessive traffic on the control channel. Hence, there is a need to develop 
cooperative strategies at the FAP level as it has been proposed recently in ll30l . ll3T1l . [|32ll . 
A novel form of distributed compress-and forward scheme with decoder side information is 
studied in ll33l while further mechanisms of cooperation have been studied in the context of 
providing a reliable backhaul to the FAPs such as in ||34| . 

The main contribution of this paper is to propose, within the context of wireless femtocell 
networks, a framework for macrocell-femtocell cooperation which allows to alleviate the uplink 
interference at the FAP and reduce the transmission delay at the macrouser. Unlike existing 
network architectures, we propose a model in which macro cellular users are granted femtocell 



3 



access using a device-to-device (D2D) link ll35l that enables them to communicate with a 
femtocell user (FUE) that, in a second phase, acts as a relay for macrocell traffic. In essence, 
whenever an MUE and an FUE cooperate, the MUE forwards its own traffic to the FUE which, 
in turn, combines the MUE's traffic with its own data and relays it to its serving FAR This 
proposed concept allows the MUEs to explore nearby femtocells by cooperating with the FUEs, 
even when the FAPs adopt a closed-access policy and have a limited coverage area. Clearly, 
this scheme is beneficial for any MUE, located at the cell boundary area, that is suffering a low 
performance at its serving MBS and which is unable to connect to nearby FAP due to closed- 
access policy or limited FAP coverage. Therefore, the rationale behind the proposed approach 
is to capture an important mutual benefit in co-channel femtocell networks. On the one hand, 
in such underlay femtocell network, the availability of the spectral resources depends on the 
utilization of the macrocell tier, which is performed without cross-tier coordination. As a result, 
the number of users (both FUEs and guest MUEs) is ultimately limited by the FAP is ultimately 
limited by the interference produced by the MUEs. On the other hand, the performance of 
MUEs located at a cell edge is essentially limited by the achievable SINR and large delays 
result from numerous outage events. In this respect, MUEs and FUEs have a mutual benefit to 
cooperate using the proposed approach in order to improve their performance and overcome their 
limitations. For instance, one of the main benefits of the proposed scheme is the possibility of 
separating in time uplink transmissions from cooperating MUE and FUE, allowing for cross-tier 
interference avoidance at the FAP's side. In other words, the MUE exclusively grants the helping 
FUE a portion of its superframe to transmit in exchange for cooperation [SF]. Establishing a 
D2D link between the MUE and the FUE comes with a number of advantages, notably due to 
the low transmit range. In detail, when MUEs and FUEs are close, it is possible to leverage 
D2D communication at high rates. Clearly, the low transmit range also implies low average 
transmit power, which allows energy savings at the MUE side. Moreover, a direct link between 
MUEs and FUEs can also lead to the introduction of novel services and application which 
require a direct link between MUEs and FUEs. Therefore, in this paper, we introduce a holistic 
approach in which we study cross-tier cooperation in a macrocell-femtocell network accounting 
for delay, power constraints, and optimization of the rewarding mechanism. In summary, our 
key contributions are the following: 

• We design a framework for macro-femto cooperation in which the end user benefit is 
quantified in terms of both throughput and delay. 

• We tackle the macro-femto coexistence using a cooperative game theoretical approach, by 
formulating a coalitional game in which MUEs and FUEs are the players. We show that 
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the game is in partition form as it takes into account the external interference between the 
formed coalitions. 

• A distributed coalition formation algorithm is proposed through which MUEs and FUEs 
self-organize to reach the recursive core of the game. 

• Within each coalition we apply a generalized optimization algorithm so as to maximize the 
FUEs revenue, by adequately partitioning the available superframe and setting the transmit 
power for serving the MUEs in the coalition. 

The proposed approach enables the MUEs and femtocells to self-organize and jointly establish 
a D2D link with a FUE, which will access the core network through an FAP access. These 
operations rely on self-organizing capabilities at the FUEs and MUEs and minimally involve 
the MBS, since it not notified until the players are actually cooperating. Moreover, the proposed 
approach is independent of the access policy in use at the FAP side, and could be applied even 
when the latter adopts a closed-access policy (or when it is congested in open access mode, or its 
maximum allowable MUEs is reached in hybrid access mode). System level simulations show 
that the proposed coalition formation algorithm yields significant gains, in terms of average 
rate per MUE, reaching up to 205% compared to the non-cooperative case, for a network with 

= 200 femtocells. 

The rest of this paper is organized as follows. In Section UIl we describe the considered system 
model and analyze the limitations of the non-cooperative approach. In Section III we model 
the macro-femto cooperation as a coalitional game and discuss its properties. In Section IV, we 
describe how to optimize the main parameters in the game and provide a distributed algorithm 
for coalition formation. Simulation results are discussed in Section V and finally conclusions 
are drawn in Section VI. 

II. System Model 

Consider the uplink direction of an Orthogonal Frequency Division Multiple Access (OFDMA) 
macrocell network (e.g., an LTE-Advanced or WiMAX macrocell) in which FAPs are 
deployed. These FAPs are underlaid to the macrocell frequency spectrum, and, within the 
femtocell tier, neighboring FAPs are allocated over orthogonal frequency subchannel^l]- Let 
J\f = {1, . . . ,n, . . . , N} and Ai = {1, . . . , m, . . . , M} denote, respectively, the sets of all FAPs 
and MUEs in the network. Every FAP n E M serves L„ FUEs. Let = {1, ...,/,... , L„} 
denote the set of FUEs served by an FAP n G M. 

'We assume that upon startup each femtocell senses the spectrum occupation of the adjacent R\Ps and, based on that, it 
occupies a disjoint set of subchannels, thus, avoiding interference from the FAPs in proximity II13I . 1101 . 1191 , 1171 . 
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The packet generation process at each MUE-MBS link is modeled as an M/D/1 queuing 
systenj^, in which packets of constant size are generated using a Poisson arrival process with an 
average arrival rate of A^, in bits/s. Similarly, the link between FUE / and its belonging FAP 
is modeled as an M/D/1 queuing system with Poisson arrival rate of A;. In the non cooperative 
approach, the MBS offers MUE m a link transmission capacity (measured in bits/s) of: 

2 

/i^ =Elog(l + — 2p_^ (1) 

where B is the bandwidth of a subchannel, |i/m,o| is the channel gain between MUE m and the 
MBS denoted by subscript 0, Pm is the power used at MUE m, $° is the set of FUEs operating 
on the same subchannel as MUE m, |i^^;,o| is the channel gain between FUE / and the MBS, 
Pi is the power used at FUE / and cr^ is the noise variance of the symmetric additive white 
Gaussian noise (AWGN). The quality of the signal received at the MBS is generally limited 
by the signal strength, since the MUE-MBS link is often in non line-of-sight (NLOS) and 
corrupted by the channel fluctuations and interference from FUEs. In contrast, the femtocell 
coverage is characterized by higher signal to noise ratio, resulting from the shorter distance 
between FUE and FAP, and more favorable channel conditions. However, due to the nature 
of underlay spectrum access, FAPs are limited by the interference from nearby MUEs and by 
capacity in terms of number of available spectral resources. As a matter of fact, each FAP n 
provides a generic FUE / G with a link transmission capacity of : 

""'^ = B log (i + i^^Ar— . (2) 

^^me'I'Jf,. \^'m,n\ m + 
2 

where B is the bandwidth of one assigned subchannel, \Hi^n\ is the channel gain between 
FUE / G Cn and its belonging FAP n, C is the set of MUEs operating on the same 
subchannel as FUE / G £„, \Hm,n\ is the channel gain between MUE m and FAP n. One of 
the aims of this work is to evaluate the effects of cross-tier interference, thus, the transmission 
capacity in ^ only accounts for the interfering MUEs. However, the proposed solution can 
still be applied with some modifications whether a central or distributed frequency planning is 
adopted. 

The probability of successful transmission can be computed as the probability of maintaining 
the SENR above a target level 7™ and 7/, respectively for a MUE or a FUE, and expressed as: 

^Other queue types, e.g., M/G/1 can be considered, without loss of generality. 
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E;g<i,p|-f^;,o| -Pi+c^ 



(3) 



To reduce the outage in MUE-MBS transmissions, a Hybrid Automatic-Repeat-ReQuest 
protocol with Chase Combining (HARQ-CC) is employed at the medium access control layer 
[|37l . In this scheme, erroneous packets at the destination are preserved so that they can be 
soft-combined with retransmitted ones. In general, this procedure, carried out at the MUE 
side, is highly costly since the MUE has to spend additional power for packet retransmission. 
Consequently, the effective input traffic Am from an MUE m, accounting for a maximum of D 
retransmissions is: 

D 

Am Am ^ ^ 

d=l 

We consider M/D/1 queueing delay for the MUEs m E Ai, and thus the average waiting time 
can be expressed by Little's law ll38l as: 

= ^ (5) 

Note that once a transmission on a MUE-MBS link drops due to an outage event, it is reiterated 
up to D times (otherwise dropped), and the increased congestion represented in (H]) produces 
an average higher delay at the end user, as expressed in ([5]). 

III. Femtocell Cooperation as a Coalitional Game in Partition Form 

In this section, we formulate the problem of cooperation between FUEs and MUEs as a 
coalitional game in partition form, whose solution is the concept of the recursive core. The aim 
of the proposed cooperative approach is to minimize the delay of the MUE transmissions through 
FUE assisted traffic relay, considering bandwidth exchange as a mechanism of reimbursement 
for the cooperating FUEs. 

In existing wireless networks, FUEs and MUEs are typically scheduled independently, regard- 
less of the access policy used at the FAP side. However, the objectives of the FAPs and the MUEs 
are intertwined from different viewpoints. At the FAP side, high interference level can be due to 
MUEs operating over the same subchannel which, consequently limits the achievable rates. At 
the MUE side, poor signal strength reception may result in a high number of retransmissions and. 



7 



hence, higher delays. To overcome this, we propose that upon retransmissions, an MUE might 
deliver its packets to the core network by means of FUE acting as relay terminal. In this case, at 
each relay FUE, the incoming packets are stored and transmitted in a First-In First-Out (FIFO) 
fashion on the access line through its own FAR We model each relay FUE as a M/D/1 queue 
and use the Kleinrock independence approximation 1391. For the relay FUE, cooperation incurs 
significant costs in terms of delay and spectral resources, since the FUE relays the combined 
traffic A/ over its originally assigned subchannels. Therefore, it is reasonable to assume that FUEs 
will willingly bear the cooperation cost only upon a reimbursement from the serviced MUEs. We 
propose that, upon cooperation, the MUE autonomously delegates a fraction a (0 < a < 1) of its 
own superframe to the serving FUE /. At the relay FUE /, the portion a is further decomposed 
into two subslots according to a parameter < /3/ < 1. The first subslot a/3/ is dedicated to 
relay MUE's traffic. The second subslot of duration «(! — /3/) represents a reward for the FUE 
granted by the serviced MUE, and it is used by the FUE for transmitting its own traffic. This 
method is known in the literature as spectrum leasing ||36l or bandwidth exchange ||40l and 
it represents a natural choice for such kind of incentive mechanisms. The above approach is 
applied to MUEs with one assigned subchannel, nevertheless, it could be extended to the case 
of multiple assigned subchannels with some modifications in the negotiating phase. In that case, 
the relay FUE should be initially informed on the subchannels the MUE can potentially lease. 
Then, the FUE would communicate its preference, according to the highest gain it can achieve, 
for a given a and /3/. 

It is worth emphasizing that the proposed solution could still be applied in conjunction 
with an open, hybrid or closed access policy. Moreover, MUE transmissions would not require 
additional spectral resources, as the entire proposed scheme operates without changing the 
original spectrum allocation in both the femtocell and the macrocell tiers (since it occurs on a 
D2D link). Figure [H illustrates the considered scenario compared to the traditional transmission 
paradigm. 

Note that, this concept solution allows to align and separate in time the transmissions allowing 
to avoid interference at the FAP from the MUEs within the coalition. In order to do that, we 
assume that operations are synchronized at the system level through IP based synchronization 
techniques such as IEEE 1588 [|41| in standard or enhanced form. In order to increase their 
throughput and reduce MUE-to-FAP interference, the FAPs have an incentive to cooperate and 
relay the MUEs' traffic. In this respect, FUEs may decide to service a group of MUEs, and thus 
form a coalition Si in which transmissions from FUE / and MUEs within the same coalition 
are separated in time. The proposed cooperation scheme can accommodate any relaying scheme 
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Fig. 1. A concept model of the proposed solution compared to the traditional non-cooperative approach. 

such as decode-and-forward or compress-and-forward schemes. In this work, we use a decode- 
and-forward relay scheme, assuming that a packet is successfully received if the respective 
SINR satisfies the conditions in ([3]). Finally, the achievable service rates for MUEs and FUEs 
in the cooperative approach become: 

/^m("'A) = min{ (1 -a)/i^, aA/if}, 



with, 



f^in = log y- + - — — j . 0) 



2 



where l-f^m.zT denotes the channel gain of the relay link from MUE m E Si and FUE /. Note 
that the factor (1 — a) in the first term of Q is due to the fraction of superframe occupied by 
the D2D transmission, while the second factor af3i accounts for the fraction occupied by the 
forward transmission by the FUE. Due to the fact that MUEs are originally assigned orthogonal 
subchannels, the first hop of the relay transmission is not affected by interference. Moreover, 
note that by separating the transmissions from MUE and FUE within the superframe, the FUE 
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forward transmissions are affected only by interference from non cooperative MUEs, outside 
the coalition. At this point, since the FUE may have to transmit independent packets of its own, 
the input traffic generation (or the packet arrival at the queue of the FAP) has to account for the 
packets generated at the FUE and at the MUEs for which the FUEs is relaying. Consequently, 
the effective traffic A; generated by FUE /, accounting for the retransmissions becomes: 

D 

k ={k+Y. Am) ^PtKl - PtlY-\ (9) 
mG5; d=l 

where D is the maximum number of retransmissions before the packet is dropped, Pti and A^ 
are computed as in ([3]), dH) considering that the SINR this time refers to the FUE-FAP link and 
using the Kleinrock approximation to combine traffic arrival rates from queues in sequence. 

We model every D2D link as a M/D/1 queue system and investigate the average delay incurred 
per serviced MUE. For a given MUE m served by FUE /, we express the average delay as: 

= ^"^ . . (10) 

2/x^(//^ - Am) 

It is important to underline that, to guarantee the stability of the queues, for any MUE m 
serviced by a FUE in the network, the following condition must hold: 

Am</i^. (11) 

In the event where this condition is violated, the system is considered unstable and the delay 
is considered as infinite. In this regard, the analysis presented in the remainder of this paper 
will take into account this condition and its impact on the coalition formation process (as seen 
later, a coalition where Am > fJ-m ^i^^ never form). Having considered this, we now define 
= EmGS, Am Ell ^^/(l " PtiY"' and Df = ^^c^lc_-^^^ as the delay at the FUE for 
transmitting the traffic of the MUEs' in the coalition. Finally, we can compute the average 
delay for an MUE as a sum over the MUE-FUE and FUE-FAP hops, as: 

DZ = D^ + Df. (12) 

We assume that the relay FUE performs half-duplex operations, i.e., they first receive the 
MUE's packets in a transmission window wide (1 — a) in the subchannel originally utilized at 
the MUE. Successively, each FUE forwards the MUE's packets in the next transmission window 
wide {a(3i) in a FIFO policy. We further foresee that, once the packets are forwarded towards 
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the core network, they can be traced back to the original source by means of a small packet 
header which include the mobile user ID. 

A. Coalitional Game Concepts 

Coalitional games involve a set of players, who seek to form cooperative groups, i.e., coali- 
tions, in order to improve their performance or gains. A coalitional game is defined by a set of 
players, i.e., the decision makers seeking to cooperate and a coalitional value (which is either a 
function or a set of vectors) which quantifies the worth of a coalition in a game, i.e., the overall 
benefit achieved by the coalition. Classical coalitional problems are typically modeled in the 
characteristic form, in which the utility of a coalition is not affected by the formation of other 
distinct coalitions [|42l . [|43l , H4]| . In contrast, for coalitional games in partition form Il44ll . 
the value of any coalition strongly depends on how the players outside Si have organized 
themselves, i.e., which coalitions they formed. Although coalitional games in partition form 
are inherently complex to solve, they capture realistic inter-coalition effects that arise in many 
problems, notably in wireless and communication networks. In this context, finding an optimal 
solution for games in partition form is a challenging task and is currently a topic of high interest 
in game theory [gll, [|45l, [|46l, [gTl, [gill (and references therein). 

In this section, we mathematically model the problem of macrocell-femtocell cooperation as 
a coalitional game with the FUEs and MUEs being the players. In particular, having defined 
V]/ = TVf U { UjjeA/''^"} °f '•^^ players in the proposed game, the rate and the delay 

achieved by the members of any coalition S"; C \1/ that forms in the network is affected by 
the cooperative behavior of the users outside Su i.e., FUEs and MUEs in ^ \ Su and thus, we 
remark the following: 

Remark 1: The proposed game , U) is in partition form. 

This property stems mainly from two reasons. First, under the non cooperative approach, 
MUEs fully utilize the assigned superframe and, hence, transmit for its whole duration. In 
consequence, non-cooperative FUEs and MUEs allocated over the same subchannel can collide 
for the whole transmission duration. In contrast, when an MUE and an FUE belong to the same 
coalition, the MUE transmits for a fraction (1 — a), while the remaining fraction is granted 
at the FUE in exchange for relaying, hence avoiding collisions between coalitional members. 
Second, cooperating MUEs transmit over a D2D link which is locally established and has a low 
transmission range. Therefore, when cooperating, the transmit power at the MUEs are sensibly 
lower when compared to the non-cooperative scheme and the consequent level of interference 
suffered at the FAPs outside the coalition is generally lower. As a result, the performance of a 
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coalition depends on the partition of the network n,i, (11^, is a partition of \E'). We will henceforth 
include this dependence in the definition of the achievable rate in ^ : /.if (a, 11^), where 
i E {m, 1} (i.e., MUE or FUE). Given this property, one suitable framework for modeling 
the macrocell-femtocell cooperation is that of a coalitional game in partition form with non 
transferable utility which is defined as follows Il43l : 

Definition 1: A coalitional game in partition form with non transferable utility (NTU) is 
defined by a pair (^! , U) where ^ is the set of players (i.e., MUEs and FUEs), and ?7 is a 
mapping such that for every coalition Si C U{Si, H^) is a closed convex subset of RI'^'I that 
contains the payoff vectors that players in Si can achieve. 

As discussed in the previous section, it is clear that MUEs and FUEs have a strong incentive 
to cooperate to improve their performance using advanced techniques such as relaying and 
spectrum leasing. Since MUEs and FUEs exhibit a tradeoff between the achievable throughput 
and the transmission delay, we use a suitable metric to quantify the benefit of cooperation defined 
as power of the network. Indeed, the power is defined as the ratio of maximum achievable 
throughput and delay (or a power of the delay) ll39l , [|48l . P9l . Thus, given a coalition Si, 
composed by a set of IS";! — 1 MUEs and a serving relay FUE /, we define a mapping function 
f/(Si,n^) as: 

u{Su n^) = [xe Mi^'i I x,{Su n^) = ^"^c';^^^^' , g 5,}, (13) 

where 5 E (0, 1) is a transmission capacity-delay tradeoff parameter to model the service 
tolerance to the delay. The set U{Si, H^) is a singleton set and, hence, closed and convex. Note 
that, the player's payoff denoted by Xi{Si, 11$) directly refers to a ratio between the achievable 
throughput and the average delay for player i in coalition Si and quantifies the benefit of being 
a member of the coalition. In consequence, the game (\E', U) is an NTU game in partition form 
and, within each coalition, the utility of the players is univocally assigned. 

B. Recursive core 

In order to solve the proposed coalition formation game in partition form, we will use 
the concept of a recursive core as introduced in llSOl and further investigated in lISTIl . Il52ll . 
Il53l . The recursive core is one of the key solution concepts for coalitional games that have 
dependence on externalities, i.e., in partition form. Due to the challenging aspect of NTU 
games in partition form, as discussed in IISTI , ||52ll , [[531 the recursive core is often defined for 
games with transferable utility where the benefit of a coalition is captured by a real function 
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rather than a mapping. By exploring the fact that, for the proposed game, as seen in (fT3l) is a 
singleton set, then we can define an adjunct coalitional game {"^^v) in which we use, for any 
coalition Si, the following function over the real line (i.e., similar to games with transferable 
utility) which represents the sum of the users' payoffs: 



as the value of the game. Then, for every coalition achieving (fT4l) . the individual payoffs of 
the users are given uniquely by the mapping in (fT3l) . By doing so, we are able to exploit the 
recursive core as a solution concept for the original game (\E', U) by solving the game (\&, v) 
while restricting the transfer of payoffs to be according to the unique mapping in (fT3l) . 

Further, given two payoff vectors x,y E 'M)^'^, we let a; >5'j y if Xi > Ui for all i E Si and 
for at least one j E Si Xj > yj. We also define an outcome as couple (x, n,i,), where x is a 
payoff vector resulting from a partition H^. Further, let Vl{^! , v) denote a set of all the possible 
outcomes of \E'. 

Essentially, the recursive core is a natural generalization of the well-known core solution for 
games in characteristic form, to games with externalities, i.e., in partition form llSOl Lemma 10]. 
In fact, when applied to a game in characteristic function form, the recursive core coincides 
with the original characteristic form core [l42||. The recursive core is a suitable outcome of a 
coalition formation process that takes into account externalities across coalitions, which, in the 
considered game, are represented by effects of mutual interference between coalitions. Before 
delving into the definition of the recursive core, we need to introduce the concept of a residual 
game: 

Definition 2: A residual game {TZ, v) is a coalitional game in partition form defined on a 
set of players TZ, after the players in \1' \ 7^ have already organized themselves in a certain 
partition. These players that are outside TZ are called deviators, while the players in TZ are 
called residuals. 

Consider a coalitional game (\E', v) and let Si be a certain coalition of deviators. Then, let 
TZ = \ Si denote the set of residual players. The residual game iTZ,v) is defined as a game 
in partition form over the set TZ. Clearly, a residual game is still in partition form and it can 
be solved as an independent game, regardless of how it was generated as discussed in llSOll . 
To better present this concept, we will provide an intuitive introduction. For instance, when 
some deviators reject an existing partition and decide to reorganize themselves into a different 
partition, their decisions will, in general, affect the payoff of the residual players. As a result, 
the residual players for a new game that is part of the original game (e.g., the game over the 




Y.i=i^iiSh^^)^ if \Si\ > 1 anda > 0, 
0, otherwise, 



(14) 
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whole set \E'), but with a certain part of the partition (composed by deviators) already fixed. In 
consequence, one of the main attractive properties of a residual game is its consistency as well 
as the possibility of dividing any coalitional game in partition form into a number of residual 
games which, in essence, are easier to solve. In fact, any game in partition form can be seen 
as a collection of residual games, and each one of those can be solved as if it was the original 
one. The solution of a residual game is known as the residual core which is defined as follows: 

Definition 3: The residual core of a residual game (IZ, v) is a set of possible game outcomes, 
i.e., partitions of IZ that can be formed. 

One can see that given any coalitional game {^,v), residual games are smaller than the 
original one and therefore computationally easier to analyze. Given any coalitional game (\E', v), 
the recursive core solution can be found by recursively playing residual games, which, in fact, 
yields the following definition as per ||50l Definition 2]: 

Definition 4: The recursive core of a coalitional game v) is inductively defined in four 
main steps: 

1) Trivial Partition. Let v) be a coalitional game. The recursive core of a coalitional game 
where ^=A^ U £„ is composed by the only outcome with the trivial partition composed 
by the single player i: C{{i} ,v) = {v{i),i). 

2) Inductive Assumption. Proceeding recursively, consider a larger network and suppose the 
recursive core C{Tl, v) for each game with at most — 1 players has been defined. Now, 
we define the assumption A{Tl, v) about the game {TZ, v) as follows: A{Tl, v) = C{TZ, v), 
if C{n, ^ ; A{n, v) = fi(7^, v), otherwise. 

3) Dominance. An outcome (x, 11^) is dominated via a coalition Si if for at least one 
(y^\5^,nvi,\5j G Ai'^XSi^v) there exists an outcome ((y^^, y^^^J, n^, ung,\cjj G n{'^,v) 
such that {ys,,y^\si) x. 

4) Core Generation. The recursive core of a game of |^| players is the set of undominated 
outcomes and we denote it by C(\l/,f). 

Note that, in Definition H the concept of dominance in step 3) inherently captures the fact 
that the value of a coalition depends on the belonging partition. Hence, it can be expressed 
in the following way: given a current partition IT* and the respective payoff vector x, an 
undominated coalition Si represents a deviation from in such a way that the resulting 
outcome ((y^^, y^^^J, H^^ U n^^s'J is more rewarding for the players of Si, compared to x. 

Since a partition uniquely determines the payoffs of all the players in the game, the recursive 
core can be seen as a set of partitions that allow the players to organize in a way that provides 
them with the highest payoff. It is important to underline that the recursive core is achieved by 
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verifying relevant properties of rationality, well-definition and efficiency as discussed in [|50l . 
In detail, with rationality it is intended that players never choose an inferior (i.e., dominated) 
strategy, therefore, they always pursue a profitable strategy. The recursive core is also well- 
defined because when it exists, its solution is unique. Furthermore, efficiency is a consequence 
of the fact that there is no preferred in the set composed by the recursive core, and thus, all the 
included partitions are equivalent in terms of individual payoff. 

Given these properties, once a partition in the recursive core takes place, the players have no 
incentive to abandon it, because any deviation would be detrimental. As a result, a partition in 
the recursive core is also stable since it is a partition which ensures the highest possible payoff 
for each one of the players who have no incentive to leave this partition. 

Similar to many game theoretic concepts such as the core or the Nash equilibrium, the 
existence of a recursive core for a coalitional game is a key issue. In Il50l , the author shows that 
the existence of the recursive core requires at least one residual core (and not all of them) to 
be nonempty. In particular, this means that at least a subset of the players in the network must 
have defined a preference on how to organize themselves, i.e., how to partition the network. 
Moreover, an empty residual core reflects a case in which the players of the corresponding 
residual game do not identify any preferred network partition, or in our proposed cooperation 
scenario, can equivalently choose between cooperating or not. 

Therefore, for the proposed coalitional game, the emptiness of a residual core does not happen 
and this can be justified as follows. As per Definition H the recursive core is evaluated through 
a sequence of residual games over subsets of players (i.e., MUEs and FUEs, in our case) in the 
network. When a given residual core is empty, it is still possible to solve a larger game which 
contains this as a residual game, in a nested fashion. Hence, the existence of the recursive core 
is in fact guaranteed as long as one can find at least one residual core that is nonempty. Thus, 
the recursive core is a solution concept that exists for any game in partition form, unless all the 
residual cores are empty. 

In practice, for the proposed coalitional game, the case in which all residual cores (and, thus, 
the recursive core) are empty is unlikely to emerge. As a matter of fact, this would represent a 
network in which any partition of mobile users is equally likely to form. In a practical wireless 
network, this would imply that the MUEs and FUEs are indifferent (i.e., achieve the same 
payoff) between states in which they are actually suppressing interference and relaying their 
transmissions (e.g., cooperatively using a D2D link with an FUE) and states in which they are 
actually suffering from this interference and transmitting to the MBS. 

In a nutshell, for the proposed coalitional game, one can use the concept of residual cores 
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in order to find a partition in the recursive core, i.e., a stable and efficient partition, as will be 
further described in the next section. 

C. Distributed implementation of the Recursive core 

Once a coalition Si has formed, the FUE / optimizes its own payoff by deciding upon /?/ and 
the transmit power. At the FUEs side, relaying traffic for a set of MUEs incurs a cost that 
must be taken into account by the FUE before making any cooperation decision. In this paper, 
we consider a cost in terms of the transmit power that each FUE spends to transmit for MUEs 
within the same coalition. Namely, a FUE spends to relay MUEs traffic and (1 — /3/)P/^^ 

for its own transmissions, while the overall transmit power is limited by Pmax as: 

^^p/«) + (1 _ /3^)pf ) < p^^^. (15) 

Leased spectrum and transmit power can be finely tuned in order to maximize the payoff of 
each member in the coalition. Accordingly, after a coalition has formed, given a value of a, 
FUE / e Cn jointly optimizes the transmit power and the parameter (3i, by solving the following 
problem: 

max Xi{Si,Ii^f) (16) 

s.t. < a, A < 1; PiPI""^ + (1 - Pi)Pr < Pmax. (17) 

Mainly, the FUE is fed back with the estimated aggregated interference from the MUEs m 
outside the coalition (and included in $^), which can be either measured by its own belonging 
FAP, or extimated by considering the MUEs in the proximity flU. The problem in (fT6l) can be 
solved using well known optimization techniques such as those in ll54l . 

To reach a partition in the recursive core, the players in \1/ use Algorithm \T\ This algorithm 
is composed mainly of three phases: Interferer discovery, recursive core coalition formation, 
and coalition-level cooperative transmission. Initially, the network is partitioned by |^| single- 
ton coalitions (i.e., non-cooperating mobile users). The MBS periodically requests Received 
Signal Strength Indicators (RSSIs) measurements from its MUEs to identify the presence of 
femtocells which might cooperatively provide higher throughput and lower delays through D2D 
communication. A similar measurement campaign is carried out at the FUE, as requested by 
the respective FAR Successively, for each of the potential coalitional partners, the potential 
payoffs in (fT3l) are computed, considering the mechanisms of spectrum leasing captured in Q. 
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Algorithm 1 Distributed coalition formation algorithm for uplink interference management in two-tier femtocell 

networks 

Initial State: The network is partitioned by = A4U £.„ with non-cooperative MUEs and FUEs. 

repeat 

Phase I - Interferer Discovery 

a) Through RSSI measurements, each FUE detects nearby MUEs, active on the same subchannel, and vice versa. 

b) For each of the occupied subchannels, each FUE sorts the interfering MUEs from the stronger to the weaker. 

c) Based on the measured RSSIs, each MUE m in ^ sorts the sensed FUEs from the supposedly closer to the farther. 
Phase II - Coalition Formation 

for all mutually interfering MUEs and FUEs in 5' do 

a) Each MUE and FUE sequentially engages in pairwise negotiations with the strongest discovered interferer, to identify 
potential coalition partners. 

b) Each MUE and FUE in 'I' estimates the achieved rate and delay and computes its utility a-i(S', 11*) as in U3b . 

c) FUEs and MUEs engage in a coalition formation which ensures the maximum payoff, 
end for 

until any further growth of the coalition does not result in a payoff enhancement of at least one player or decreases the 
other coalitional members' payoffs. 

Outcome of this phase: Convergence to a stable partition in the recursive core. 
Phase III - Spectrum Leasing and Cooperative Transmission 

a) Within each coalition, the MUEs notify the serving MBS, and connect to the serving FUE through the D2D operations 
described in Section HiH 

b) Each FUE I G Si optimizes its payoff by balancing the transmit power and the transmission window /3; by solving 
the optimization problem in l ll6b . 

Ultimately, each MUE or FUE sends a request for cooperation to its counterpart which ensures 
the highest payoff. If both MUEs and FUEs mutually approve the cooperation request, they form 
a coalition, set up a D2D connection and the MUE acknowledges its MBS about the established 
connection. Even during the D2D transmission, the MUEs still maintain a connection to the 
radio resource control of its original MBS. Being limited by interference, the most eligible 
partners for FUEs are dominant interfering MUEs, while, vice versa for a MUE, the higher 
utilities are granted by FUE in the vicinity or experiencing good channel gains. The recursive 
core is reached by considering that only the payoff-maximizing coalitions are formed. Clearly, 
this algorithm is distributed since the FUEs and MUEs can take their individual decisions to join 
or leave a coalition, while, ultimately reaching a stable partition, i.e., a partition where players 
have no incentive to leave the belonging coalition. Those stable coalitions are in the recursive 
core at the end of the second stage of the algorithm. Finally, once the coalitions have formed, 
the members of each coalition proceed to construct a D2D link and perform the operations 
described in Section [nil As a result, intra-coalition uplink interference at the respective FAPs 
is suppressed and the MUEs achieve lower delays. 



17 



The proposed distributed solution significantly reduces the intrisic complexity of the coalition 
formation problem as it leverages on the formulation of reduced games among mutual interferers 
within transmit range, which reduces the search space. Moreover, as per step (b) in Phase I, 
since the dominant interferers are the most eligible to join the FUE's coalition, they are sorted 
by descending values of the estimated interference they produce and processed accordingly, 
which further reduces the number of algorithm iterations. 

With regards to the convergence of Algorithm [H note that the limitation on the cost for 
cooperation as per (15) limits the number of potential coalitional partners and, thus, the number 
of combination that the algorithm has to evaluate. Moreover, by choosing the coalitional partners 
from an ordered list of interfering MUEs, the resulting FUE's payoff is non decreasing after 
each iteration of the algorithm. Finally, Algorithm [T] terminates at the first iteration, in which an 
FUE cannot further increase its payoff without being detrimental for the other coalition partners. 
Therefore, by cooperatively solving the strongest interference, the FUEs achieve the maximum 
achievable payoff, and, therefore, have no incentives to break away from the belonging coalitions 
since it would lead to lower payoffs. Thus, the formed coalitions represent a stable network 
partition which lies in the recursive core. 

The proposed Algorithm [T] converges to a stable partition which is undominated as per Defini- 
tion HI Although the recursive core might include more than one undominated partition, they are 
all equivalent, in the sense that they provide the same average player's payoff. Furthermore, due 
to the concept of dominance since a deviation occurs only towards coalition which guarantees 
a strictly higher payoff, as per step 3) in Definition IH a player MUE or FUE has no incentive 
to deviate towards equivalent partitions in the recursive core, as they provide equivalent average 
payoffs. 

IV. Simulation Results and Analysis 

For system-level simulations, we consider a single hexagonal macrocell with a radius of 1 Km 
within which FAPs are underlaid with M MUEs. Each FA? n E J\f serves L„ = 1 FUE 
scheduled over orthogonal subchannel, adopting a closed access policy. We set the maximum 
transmit power at MUEs and FUEs to Pmax = 20 dBm, which includes both the power for the 
serviced MUE's and its own transmissions as in ( fTSl ). Transmissions are affected by distance 
dependent path loss shadowing according to the 3GPP specifications ||55l . For both femto users 
and MUEs, we assume that power control fully compensates for the path loss. Moreover, a wall 
loss attenuation of 12 dB affects MUE-to-FUE transmissions. The considered macrocell has 500 
available subcarriers, each one having a bandwidth of 180 KHz, and dedicates one OFDMA 
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TABLE I 

System Parameters 



Macrocell radius 


IKm 


Max TX power at MUE and FUE: Pmax 




20 dBm 


Femtocell radius (r) 


10-50m 


Max number of retransmissions (D) 




4 


Carrier frequency 


2.0 GHz 


Forbidden drop radius (femto) 




0.2m 


Number of FAPs 


1 - 360 


Total Bandwidth 




100 MHz 


Number of FUEs per femtocell 


1 


Subcanier Bandwidth B 




180 kHz 


Number of MUEs per macrocell 


1- 500 


Thermal Noise Density 




-174 dBm/Hz 


Input traffic macro: Am (femto: A;) 


150 Kbps 


Path Loss Model [dB] (indoor) 


37 


+ 301ogio(d[m]) 


Miri required SESfR at the MBS: 7,„ (FAP: 7;) 


10 dB (15 dB) 


Path Loss Model [dB] (outdoor) 


15.3 


+ 37.61ogio(d[m]) 


FAP antenna gain 


dBi 


External wall penetration loss 




12dB 


Forbidden drop radius (macro) 


50m 


Lognormal shadowing st. deviation 




10 dB 


Number of antennas at the MBS (FAP) 


1 (1) 


Shadowing congelation between FAPs 








subchannel to each transmissions. As a matter of fact, assigning multiple subchannels to an 
MUE would extend the produced interference to more than one FAP, and lead to the formation 
of overlapping coalitions. However, performing coalition formation with multiple membership 
yields a combinatorial complexity order due to the need for distributing the capabilities of a 
user among multiple coalitions. Thus, assigning one subchannel enables the formation of disjoint 
coalitions and optimizes the tradeoff between benefits from cooperation and the accompanying 
complexity p2|. Il56l . Further simulation parameters are included in Table IH To leverage channel 
variations, statistical results are averaged on 10000 simulation rounds. 

In Fig. [21 we show a snapshot of a femtocell network resulting from the proposed coalition 
formation algorithm with = 200 FAPs that are randomly deployed in the network. The 
partition in Fig. [2] lies in the recursive core of the game and is, thus, stable (both FUE and 
MUE have no incentive to deviate). In this figure, note that although the MUEs are located 
outside the femtocells, they might be in proximity of a femtocell and potentially interfere with 
it. If this the case, the FUE has an incentive in forming a coalition with the interfering MUE 
since it would neutralize its interference. Furthermore, note how the cooperative MUEs are 
located within the transmission range of a FUE, leveraging on a smaller distance dependent 
path loss. Conversely, spatially separated MUEs and FUEs are most likely to form singleton 
coalitions, hence not cooperate. In a nutshell. Fig. [2] shows how, using the proposed algorithm, 
the FUEs and the MUEs in a network can self-organize into a partition composed of disjoint 
and independent coalitions and which is stable, i.e., lies in the recursive core of the game. 

In Fig. [31 we evaluate the performance of the proposed coalition formation game by showing 
the average gain of achievable payoff per MUE during the whole transmission time scale as a 
function of the number of MUEs M. We compare the performance of the proposed algorithm 
to that of the non-cooperative case, for a network with 50, 100, 200 FAPs using a closed access 
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Fig. 2. A snapshot of the two-tier femtocell network. The FAPs are modeled by a Poisson point process (squares) and they 
serve a disc of radius 20 meters. Triangles represent non cooperating MUEs which communicate with the main base station, 
represented by a diamond. Stars represent cooperating MUEs which are serviced by the FUE in the coalition (dots). 

policy. The curves are normalized to the performance of the non-cooperative solution. For small 
network sizes, MUEs do not cooperate with FUEs due to spatial separation. Thus, the proposed 
algorithm has a performance that is close to the non-cooperative case for M < 60. As the 
number of MUEs grows, the probability of being in proximity of an FUE gradually increases 
and forming coalitions becomes more desirable. Hence, the MUEs become connected to a nearby 
FUE which allows for a higher SINR, allowing for high values of payoff. For example. Fig. [3] 
shows that cooperating MUE can gain up to 75% with respect than the non-cooperative case in 
a network with = 200 FAPs and M = 160 MUEs. For larger sizes of the macrocell tier, the 
coalition formation process eventually saturates and the average gains of cooperation decrease. 
Further, note that as FUEs in the network not only represent an opportunity of cooperation for 
the MUEs, but also sources of cross-tier interference, the maximum achievable gains translate 
towards larger sizes of macrocell tier. In fact. Fig. [3] clearly shows that the average gain of 
payoff per MUE increases in the cooperative case as the number of femtocells is large, until 
each coalition reaches its maximum size. It is also demonstrated that the proposed coalitional 
game model has a significant advantage over the non-cooperative case, which increases with 
the probability of having FUEs and MUEs in proximity, and resulting in an improvement of up 
to 239% for M = 285 MUEs. 
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Fig. 3. Average gain of individual payoff per MUE, for a network having — 50, 100, 200 FAPs, 5 — 0.5, r — 20m. 

In Fig. m we show the average gain of achievable payoff per FUE as a function of the 
number of FAPs in the network N, for different number of MUEs M = 300,400,500 and 
normalize the curves to the performance of the non-cooperative solution. As previously seen 
in Fig. |3l cooperation seldom occurs in cases where MUEs and FUEs are spatially separated, 
as for low numbers of FUEs in the network. Nevertheless, as the density of FAPs increases, 
coalitions start to take place yielding to higher gains for the FUEs. For instance. Fig. |4] shows 
that the average gain of payoff per FUE resulting from the coalition formation can achieve an 
additional 15% gain with respect to the non-cooperative case, in a network with = 200 FAPs 
and M = 500 MUEs. However, for larger numbers of FAPs in the network, the average gain in 
terms of FUE's payoff decreases, as the spectrum becomes more congested and the MUEs in the 
network have already joined the most rewarding coalitions. Fig. |4] also shows the comparison 
with the optimal solution obtained through centralized exhaustive search. For example. Fig. |4] 
shows that the performance gap between the centralized and the proposed solution does not 
exceed 2.6% for a network of = 10 FAPs, while networks with more than = 10 FAPs 
are computationally and mathematically intractable, due to the exponentially increasing number 
of combinations to be evaluated [|42ll . Therefore, we demonstrated how cooperation can be 
beneficial to the FUEs in highly populated areas where the density of interferers (i.e., potential 
coalitional partners) is high and that the proposed algorithm yields a near optimal performance 
at a much lower complexity. Finally note that, since the femtocells are orthogonally scheduled. 
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Fig. 4. Average gain of individual payoff per FUE, for a network having M — 300, 400, 500 MUEs, S = 0.5, r = 20m. 

the performance of each FUE in the non cooperative approach is transparent to the density of 
femtocells in the network. 

The performance of the proposed coalition formation approach is further assessed in Fig. |5l 
where we show the average gain of payoff per FUE as the number of MUEs in the network 
varies, under different access policies. Here, the curves are normalized to the performance of 
the closed access policy. Under the open access policy, each FAP has to select a secondary 
subchannel among the least interfered to schedule the guest MUEs ||26l . Fig. [5] shows that, as 
M increases, the performance of the FUEs is undermined by the increasing level of interference 
and a closed access policy may result in a loss of up to 30%. An open access policy is 
more robust to this effect, but it cannot neutralize interfering MUEs which are not in the 
transmission range. Conversely, our proposed algorithm allows to solve the interference from 
the dominant neighboring interferers, which are more likely to be in the FUE's transmission 
range and resulting in a higher gain with respect to the open access policy of 7.6% for a network 
with 300 MUEs. 

In Fig. [6l we show the average size of the coalitions in the recursive core for a QoS parameter 
S = 0.5, in a network in which femtocells are extensively deployed (A^ = 200). Fig. [6] shows 
that due to the high number of cooperation opportunities, the network witnesses an exponential 
growth of number of MUE-FUE coalitions when the delay constraints are stringent (6 = 0.2). 
For instance, the average coalition size for a network with M = 200 MUEs is 2.87. In a less 
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Fig. 5. Performance assessment of the proposed network formation algorithm, in terms of average gain of payoff per FUE, for 
a network having TV = 200 FAPs, under different access policies. S = 0.5, r = 50m. 

delay constraining case {6 = 0.8), the incentives in cooperation are smaller but still tangible, 
as demonstrated by a network with M = 200 MUEs where the average coalition size is 1.39. 
Fig. |7] shows the growth of the number of coalitions, i.e., the size of a partition in the recursive 
core, while the number of MUEs increases. Additionally, the average number of iteration in the 
proposed algorithm is observed. The network is initially organized in a non-cooperative structure 
where each player (i.e., MUE or FUE) represents a singleton coalition, therefore the number of 
coalitions equals the number of players in the network (grey dotted line in Fig. |7]) and, since 
interferers are out of range of cooperation, the number of iterations is minimum. Initially, for 
M < 40 cooperation seldom occurs, due to the large distance between potential coalitional 
partners. As M increases, the network topology changes with the emergence of new coalitions. 
For example, when = 200 FAPs and M = 200 MUEs are deployed, 138 coalitions take 
place, requiring an average number of algorithm iterations of 6.9. Therefore, Fig. |6]and Fig. |7] 
show that the incentive towards cooperation becomes significant when the femtocells' spectrum 
becomes more congested and femtocells are densely deployed in the network. Eventually, for 
larger M, the process of coalition formation is limited by the number of MUEs which a relay 
FUE can service, given the mechanism of reimbursement in Q. 

Fig. [8] shows the cumulative distribution function of the distances between the MBS, at the 
cell center, and the coalitions formed in the network, for = 200, M = 200. This figure 
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Fig. 6. Average coalition size as function of tfie number of MUEs, for different degrees of delay tolerance, expressed by 
S = 0.2, 0.5, 0.8. N = 200, r = 20m. 
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Fig. 7. Average number of iterations till convergence and average number of coalitions as a function of the number of MUEs in 
the network. The bisectrix delimits the area of cooperation and non-cooperation, therefore, the points on the bisectrix represent 
full non-cooperative MUEs, denoted by singleton coalitions. A'^ — 200, S — 0.5. 
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Fig. 8. Cumulative distribution function of the distances where the coalitions with more than one user are located from the 
MBS, for different QoS parameters S = 0.2, 0.5, 0.8. 

shows that the requirement on the QoS, represented by the parameter 6, plays a key role in the 
coalition formation. In essence, when the delay is more stringent {5 = 0.2) than the throughput, 
as in real time services, cooperation takes place even in the vicinity of the MBS, where higher 
values of SINR are averagely possible. In contrast, when throughput is more relevant (S = 0.8), 
coalition formation generally occurs at the cell boundary area, whereas the SINRs at the MBS 
are limited by the received power. For instance, in Fig. [8] the expected value of the distance 
from the MBS for a coalition with 6 = 0.2 is d = 212 meters, while for 6 = 0.8 is d = 703 
meters. 

Fig. |9] shows the probability distribution function of coalition formation as a function of 
the portion of superframe granted to the relay FUEs, for different 6 = 0.2, 0.5, 0.8. This figure 
demonstrates that, when delay and throughput are equally relevant, an average value of a = 62% 
is required by each FUE, for serving an MUE. In contrast, for delay-constrained services, 
represented by S = 0.2, cooperation becomes more demanding and MUEs have to reimburse 
the serving FUE for an average value of a = 78%. As a result, we show that the reimbursement 
mechanism highly depends on the type of service that is required, and the network power is a 
metric which plays a key role in the coalition formation. 

Fig. [10] provides a comparison of the average individual payoff of both cooperative and 
non-cooperative approaches as a function of the mobility range of a MUE. We consider, from 
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Fig. 10. Performance assessment of the proposed network formation algorithm, in terms of average gain of payoff per MUE 
and FUE at the cell boundary area, in case of a MUE moving on the x-axis in positive direction towards a femtocell. S — 0.5. 
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Fig. 11. Comparison between the proposed solution and the existing access policies in terms of FUE's payoff vs the size of 
the femtocell. A/ = 200, N = 200, 5 = 0.5. 

different positions, an MUE close to the macrocell boundary and interfering with a femtocell 
which adopts a closed access policy. While the MUE is out of the transmission range of the 
FUE, cooperation cannot be established, thus, the interference from the MUE is unresolved. 
Conversely, although being located outside of the femtocell and behind a wall, the MUE is 
serviced by the FUE when the mutual distance is approximately 9.5 meters, yielding to a 
significant improvement in terms of respective payoffs. Fig. [10] demonstrates that the proposed 
solution can lead to an improvement at the MUE side of up to 41%. Note that our solution 
applies not only to the closed access policy, but to all the general cases where an MUE cannot 
be served by a FAP, although it is harmfully interfering with it (for instance, when the MUE 
is within interference but out of the FAP transmission range). 

In Fig.[TT]we compare our approach to different access policies in terms of average individual 
FUE's payoff as a function of a femtocell transmission range. The curves are normalized to the 
performance of the closed access policy for r = 10 meters. For small femtocell radius, which 
are currently included in 3GPP specifications [[551 , an open access policy can better protect 
the FAP from cross-tier interference with respect to a closed access policy. However, when the 
femtocell radius increases, the FAP is more insulated from the outer interference when located 
at the cell center. Thus, the closed and open access policies gradually converge. Our proposed 
solution becomes more beneficial in those cases where, despite the access policy being open. 
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the MUE cannot reach the FAP, leading to a maximum gain of 6% with respect to the open 
access policy and 14% to the closed access policy, for a femtocell radius of 50 meters. 



V. Conclusions 

In this paper, we have introduced a novel framework of cooperation among FUEs and MUEs, 
which has a great potential for upgrading the performance of both classes of mobile users in 
next generation wireless femtocell systems. We formulated a coalitional game among FUEs 
and MUEs in a network adopting a closed access policy at each femtocell. Further we have 
introduced a coalitional value function which accounts for the main utilities in a cellular network, 
namely transmission delay and achievable throughput. To form coalitions, we have proposed a 
distributed coalition formation algorithm that enables MUEs and FUEs to autonomously decide 
on whether to cooperate or not, based on the tradeoff between the cooperation gains, in form 
of increased throughput to delay ratio, and the costs in terms of leased spectrum and transmit 
power. We have shown that the proposed algorithm reaches a stable partition which lies in the 
recursive core of the studied game. Results have shown that the performance of MUEs and 
FUEs are respectively limited by delay and interference, therefore, the proposed cooperative 
strategy can provide significant gains, when compared to the non-cooperative case as well as 
to the closed access policy. 



References 

[1] D. Knisely, T. Yoshizawa, and F. Favichia, "Standardization of femtocells in 3GPP," IEEE Communications Magazine, 

vol. 47, no. 9, pp. 68 -75, Sept. 2009. 
[2] S. Ortiz, "The wireless industry begins to embrace femtocells," Computer, vol. 41, no. 7, pp. 14 -17, Jul. 2008. 
[3] S. Sesia, I. Toufic, and M. Baker, LTE - the UMTS long term evolution. A John Wiley and Son publication - UK, Aug. 

2009. 

[4] J. Zhang and G. de la Roche, Femtocells: Technologies and Deployment. New York, USA: Wiley, Mar. 2010. 

[5] Europe Commission FP7 Information and Communication Technologies project Broadband evolved FEMTO networks 

(BeFEMTO). [Online]. Available: http://www.ict-befemto.eu/home.htm 
[6] I. Guvenc, M. R. Jeong, M. E. Sahin, H. Xu, and F. Watanabe, "Interference avoidance in 3GPP femtocell networks 

using resource partitioning and sensing," in Proc. of IEEE PIMRC 2010, Indoor Outdoor Femto Cells (lOFC) workshop, 

Istanbul, Turkey, 26 Sept. 2010. 
[7] V. Chandrasekhar, J. Andrews, and A. Gatherer, "Femtocell networks: a survey," IEEE Communications Magazine, vol. 46, 

no. 9, pp. 59 -67, Sept. 2008. 

[8] D. Calin, H. Claussen, and H. Uzunalioglu, "On femto deployment architectures and macrocell offloading benefits in joint 

macro-femto deployments," IEEE Communications Magazine, vol. 48, no. 1, pp. 26 -32, Jan. 2010. 
[9] D. Choi, P. Monajemi, S. Kang, and J. Villasenor, "Dealing with loud neighbors: The benefits and tradeoffs of adaptive 

femtocell access," in Proc. of IEEE GLOBECOM 2008, New Orleans, LA, USA, 30 Nov- 4 Dec. 2008. 
[10] D. Lopez-Perez, A. Ladanyi, A. Juttner, and J. Zhang, "OFDMA femtocells: A self-organizing approach for frequency 

assignment," in Proc. of IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (IEEE 

PIMRC 2009), Tokyo, japan, 13- 16 Sept. 2009. 
[II] S.Rangan, "Femto-macro cellular interference control with subband scheduling and interference cancelation," in Proc. of 

IEEE GLOBECOM 2010, Miami, FL, USA, 6-10 Dec. 2010. 
[12] Z. Shi, M. C. Reed, and M. Zhao, "On uplink interference scenarios in two-tier macro and femto co-existing 

umts networks," EURASIP J. Wirel. Commun. Netw:, vol. 2010, pp. 4:1-4:12, Jan. 2010. [Onhne]. Available: 

http://dx.doi.org/IO. 1 155/2010/240745 
[13] L. Uarcia, K. federsen, and K Mogensen, "Autonomous component carrier selection: interference management in local 

area environments for LTE-advanced," IEEE Communications Magazine,, vol. 47, no. 9, pp. 110 -116, Sept. 2009. 
[14] H.-C. Lee, D.-C. Oh, and Y.-H. Lee, "Mitigation of inter-femtocell interference with adaptive fractional frequency reuse," 

in Proc. of IEEE International Conference on Communications (ICC) 2010, Cape Town, South Africa, 23-27 May. 2010. 
[15] F. Pantisano, K. Ghaboosi, M. Bennis, and R. Verdone, "A self-organizing solution for interference avoidance in TDD 

underlay femtocells," in 44nd Asilomar Conference on Signals, Systems and Computers, Oct. 2010. 



28 



F. Pantisano, K. Ghaboosi, M. Bennis, and M. Latva-Aho, "Interference avoidance via resource scheduling in TDD 
underlay femtocells," in Proc. of IEEE PIMRC 2010, Indoor Outdoor Femto Cells (lOFC) workshop, Istanbul, Turkey, 
26 Sept. 2010 2010. 

Y.-Y. Li, M. Macuha, E. Sousa, T. Sato, and M. Nanri, "Cognitive interference management in 3g femtocells," in Proc. 
of IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) 2009, Tokyo, Japan, 
13-16 Sept. 2009. 

H.-S. Jo, J.-G. Yook, C. Mun, and J. Moon, "A self-organized uplink power control for cross-tier interference management 
in femtocell networks," in Proc. of IEEE military communication conference (MILCOM) 2008, San Diego, CA, USA, 
16- 19 Nov. 2008. 

L. Garcia, G. Costa, A. Cattoni, K. I. Pedersen, and P. E. Mogensen, "Self-organizing coalitions for conict evaluation and 
resolution in femtocells," in Proc of IEEE GLOBECOM Workshop on Femtocell Networks, Miami, FL, U.S. A, 6-10 Dec. 
2010. 

G. Guandr, S. Bayhan, and F. Alagoandz, "Cognitive femtocell networks: an overlay architecture for localized dynamic 
spectrum access," IEEE Wireless Communications Magazine, vol. 17, no. 4, pp. 62 -70, Aug. 2010. 

V. Chandrasekhar, J. Andrews, Z. Shen, T. Muharemovic, and A. Gatherer, "Power control in two-tier femtocell networks," 
IEEE Transactions on Wireless Communications, vol. 8, no. 8, pp. 4316^328, Aug. 2009. 

C. D. T. Thai and P. Popovski, "Interference cancelation schemes for uplink transmission in femtocells," in Proc. of IEEE 
GLOBECOM 2010, Miami, FL, USA, 30 Nov. 2010. 

M. Bennis and D. Niyato, "A Q-leaming based approach to interference avoidance in self-organized femtocell networks," 
in Proc. of IEEE GLOBECOM Workshop on Femtocell Networks 2010, Miami, FL, USA, 30 Nov. 2010 2010. 
L. Giupponi, A. Galindo-Serrano, P. Blasco, and M. Dohler, "Docitive networks - an emerging paradigm for dynamic 
spectrum management," IEEE Wireless Communications Magazine, Special Issue on Dynamic Spectrum Management, 
vol. 17, no. 4, pp. 47-54, Apr. 2010. 

D. Lopez-Perez, A. Valcarce, G. de la Roche, and J. Zhang, "OFDMA femtocells: A roadmap on interference avoidance," 
IEEE Communications Magazine, vol. 47, no. 9, pp. 41 -48, Sept. 2009. 

G. de la Roche, A. Valcarce, D. Lopez-Perez, and J. Zhang, "Access control mechanisms for femtocells," IEEE 
Communications Magazine, vol. 48, no. 1, pp. 33 -39, Jan. 2010. 

H. S. Jo, P. Xia, and J. G. Andrews, "Open vs. closed access femtocells in downlink," 
submitted to IEEE Transactions on Wireless Communications, Sept. 2010. [Online]. Available: 
http;^//wncg.org/publications/dl.php?file= Andrews 1290199089.pdf 

P. Xia, V. Chandraseknar, and J. Andrews, "Open vs. closed access femtocells in the uplink," IEEE Transactions on 
Wireless Communications, vol. 9, no. 12, pp. 3798 -3809, Dec. 2010. 

G. Zhang, C. Zhang, J. Zhang, and G. Wei, "A novel uplink interference coordination scheme using high interference 
indicator," in Proc. of 72nd IEEE Vehicular Technology Conference Fall (VTC 2010-Fall) 2010, Ottawa, Canada, 6-9 Sept. 
2010. 

J. Jin and B. Li, "Cooperative resource management in cognitive WiMAX with femto cells," in Proc. of IEEE INFOCOM 
2010, San Diego, CA, USA, 15-19 Mar. 2010. 

K. Lee, O. Jo, and D.-H. Cho, "Cooperative resource allocation for intercell fairness in femtocell networks," IEEE 
Communications Letters, vol. 15, no. 2, pp. 214 -216, Feb. 2011. 

M. Bennis and M. Debbah, "On spectrum sharing with underlaid femtocell networks," in Proc. of IEEE PIMRC 2010, 
Indoor Outdoor Femto Cells (lOFC) workshop, Istanbul, Turkey, 26 Sept. 2010. 

O. Somekh, O. Simeone, H. Poor, and S. Shamai, "Cellular systems with non-regenerative relaying and cooperative base 

stations," IEEE Transactions on Wireless Communications, vol. 9, no. 8, pp. 2654 -2663, Aug. 2010. 

O. Simeone, E. Erkip, and S. Shamai Shitz, "Robust transmission and interference management for femtocells with 

unreliable network access," IEEE Journal on Selected Areas in Communications, vol. 28, no. 9, pp. 1469 -1478, Dec. 

2010. 

K. Doppler, M. Rinne, C. Wijting, C. Ribeiro, and K. Hugl, "Device-to-device communication as an underlay to Ite- 
advanced networks," IEEE Communications Magazine, vol. 47, no. 12, pp. 42 -49, Dec. 2009. 

O. Simeone, I. Stanojev, S. Savazzi, Y. Bar-Ness, U. Spagnolini, and R. Pickholtz, "Spectrum leasing to cooperating 
secondary ad hoc networks," IEEE Journal on Selected Areas in Communications, vol. 26, no. 1, pp. 203 -213, Jan. 
2008. 

E. Dahlman, S. Parkvall, and J. Skold, 3G Evolution: HSPA and LTE for Mobile Broadband. Academic Press, 2008. 
A. Leon-Garcia, Probability, statistics, and random processes for electrical engineering , (3rd Edition). Prentice Hall, 
2008. 

L. Kleinrock, "Power and deterministic rules of thumb for probabilistic problems in computer communications," in Proc. 
Int. Conf. on Communications, Boston, USA, Jun. 1979. 

D. Zhang, O. Ileri, and N. Mandayam, "Bandwidth exchange as an incentive for relaying," in Proc. of 42nd Annual 
Conference on Information Sciences and Systems (CISS) 2008, Princeton, NJ, USA, 19-21 Mar. 2008 2008. 
"IEEE Instrumentation and Measurement Society IEEE , 1588 Standard for a Precision Clock Synchronization Protocol 
for Networked Measurement and Control Systems," (IEEE Std 1588-2008), 2008. 

D. Ray, A Game-Theoretic Perspective on Coalition Formation. New York, USA: Oxford University Press, 2007. 
R. B. Myerson, Game Theory, Analysis of Conflict. Cambridge, MA, USA: Harvard University Press, Sep. 1991. 
Z. Han, D. Niyato, W. Saad, T. Ba§ar, and A. Hj0rungnes, Game Theory in Wireless and Communication Networks: 
Theory, Models and Applications. Cambridge, UK: Cambridge University Press, Aug. 2011. 

A. MacKenzie, L. DaSilva, and W. Tranter, Game Theory for Wireless Engineers. New York, USA: Morgan and Claypool 
Publishers, Mar. 2006. 

W. Saad, Z. Han, M. Debbah, A. Hj0rungnes, and T. Ba§ar, "Coalition game theory for communication networks: A 
tutorial," IEEE Signal Processing Mag., Special issue on Game Theory in Signal Processing and Communications, vol. 26, 
no. 5, pp. 77-97, Sept. 2009. 

R. Menon, A. B. MacKenzie, J. E. Hicks, R. M. Buehrer, and J. H. Reed, "A game-theoretic framework for interference 
avoidance," IEEE Transactions on Communications, vol. 57, no. 4, pp. 1087-1098, Apr. 2009. 



29 



[48] E. Altman, T. Ba§ar, and R. Srikant, "Nash equilibria for combined flow control and routing in networks: asymptotic 
behaviour for a large number of users," IEEE Trans. Automatic Control, vol. 47, pp. 917-930, Jun. 2002. 

[49] V. Vukadinovic and G. Karlsson, "Video streaming in 3.5G: On throughput-delay performance of proportional fair 
scheduling," in Proc. of IEEE Symp. on Modelini;, Analysis and Simulation of Comp. and Telecom. Systems (MASCOTS) 

2006, Monterey, CA, USA, 11-14 Sept. 2006. 

[50] L. Koczy, "A recursive core for partition function form games," Theory and Decision, vol. 63, no. 1, pp. 41-51, August 

2007. [Online]. Available: http://www.springerlink.com/content/ 5v61j22882177j33/fulltext.pdf 

[51] , "Stationary quasi-perfect equilibrium partitions constitute tne recursive core, no. U25^ 2008. [Online]. Available: 

lhttp://edocs.ub.unimaas.nl/loader/file.asp?id=1329 
[52] , "Stationary consistent equilibrium coalition structures constitute the recursive core," no. 0905, Aug. 2009. 

[Online]. Available: http://ideas.repec.Org/p/pkk/wpaper/0905.html 
[53] , "Sequential coalition formation and the core in the presence of externalities," Games and Economic Behavior, 

vol. 66, no. 1, pp. 559-565, May 2009. [Online]. Available: http://uni-obuda.hu/users/vecseya/RePEc/pkk/wpaper/0801.pdfj 
[54] S. Boyd and L. Vandenberghe, Convex Optimization. New YoiK, USA: Cambridge University Press, Sept. 2004. 
[55] 3GPP, "Physical layer aspects for evolved UTRA (Release 7)," 3GPP Technical report (TR 25.814) vJ.l.O, Oct. 2006. 
[56] G. Chalkiadakis, E. Elkind, E. Markakis, M. Polukarov, and N. R. Jennings, "Cooperative games with overlapping 

coalitions," Journal of Artificial Intelligence Research, vol. 39, pp. 179- 216, 2010. 



